WO0013414 



Publication Title: 

SYSTEM FOR EMBEDDING ADDITIONAL INFORMATION IN VIDEO DATA, 
AND EMBEDDING METHOD 



Abstract: 

It is one object of the present invention to provide a method and system for 
embedding an electronic watermark directly in an MPEG stream. AConstitutionU 

An intra-macroblock of an l-frame or of a P or B-frame is detected in an MPEG 
stream, and following the detection of an intra-macroblock of the l-frame or of the 
P or B-frame, data for one macroblock are extracted from the MPEG stream and 
buffered. An embedding pattern is embedded in the buffered macroblock without 
changing the length of VLC, and the resultant macroblock is returned to the 
MPEG stream. More specifically, a DC factor is extracted from the buffered 
macroblock, and a pseudorandom number is generated to produce an 
embedding pattern. Then, whether the bit length of the DC factor will not be 
changed by embedding the obtained embedded pattern is determined. When the 
bit length of the DC factor not be changed, the embedding pattern is embedded 
in the buffered macroblock. When the bit length will be changed, whether 1/2 of 
the embedding pattern can be embedded is determined. If possible, 1/2 of the 
embedded pattern is embedded in the macroblock. 
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(54)TitIe: SYSTEM FOR EMBEDDING ADDITIONAL INFORMATION IN VIDEO DATA, AND EMBEDDING METHOD 



(57) Abstract 

An intra-block of the I-frame or P,B -frame is detected from an 
MPEG stream. When it is detected, one macro block of data is taken out 
from the MPEG stream and buffered. The buffered macro block is 
embedded with a pattern so that the length of the VLC may be invariant. 
The macro block embedded with a pattern is returned back to the MPEG 
stream. More specifically, the DC component is detected from the 
buffered macro block and a pseudo-random number is generated in 
order to generate a pattern to be embedded. It is judged whether or not 
the bit length of the DC component is invariant when the generated 
pattern is embedded. If the bit length is invariant, the pattern is 
embedded in the buffered macro block. When the bit length is varied, it 
is judged whether or not half of the pattern can be embedded. If 
possible, the pattern is embedded. 
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^y)mm\z\t. ac. M^ma^ vlc ^bLTv^^^. g*32.^sfimi;::fe 

V^T, VLC CO demultiplex, multiplex tJ^^i^^^ i: T'.C , t*'y h7.h'J- 
^W72721(Ii|JA9-96-074) TB.P lr^m\Z^^1> ^^H^^m. i^^l^ 

^PJ=&^{^ t TMPEG2 1< ^ > ^ca^il^632.t^:^ii^^'^I^ $ tix ^ t;?^, 

^ & :}3 J: v- X X A ^ ^ t- 5 <h T . 

J6 5i tJ^fe^i <t ^ ^ ^ ^ ^^^"^ ^ ^ ^ ^ • 
S J6 3Zi^:^i£i5 J: rJ^ X 7" ^ ^^^"^ ^ ^ ^ ^ - 
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/> <b^«M P E G ^i'M P E G X h U -AA^ 

^ I-fra.e^fcti P.B-fra.e > h 7 ^ n ^ ^^fcil^^f t^. Mra 
.e^f'ii P.B-frame (D-f > h 7:/P ^^^'^Hi^ ^^^^^^ ^^^^ 

^ - > ii^ nfcT n y □ >y ^ ^ M P E G (7) X h U - A ^1- c 
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MPEG2tx:i-x-^<7)DC(7)«fi£^l^Mt-^-7^°^°"^^ (Hacrobloc 
k) (16x16 pixel)#<4TS*3A^n, ^ 1 0^^l'4t.cDSa?>3^^/^^ 
-> (po. PI. P2. P3)^^-::). «^J^^i> po^iife^2.t^^:g^»^±^ -7 

//□^□'y^C^li^SK^^YOCODCEK^^+lb. Yl(DDCfilc^^-lt, Y2.Y 

ce number = 1(0 origin). -7^ O ^_nun.ber=j flfJ 0 e>n^ 
g"^3^;:.pattern Pfi. P = PM(i.J) T^^^n^, X. MPEG20^^> 
^^lCDCE5c^HA-.TV.^ii^i. -:Pt(I<7)subblock(Ylf..^Y0. nU^ 

^^t$-tt?,DCfig5^li^l0c^A(M(i.j).Y)t^j:^. UTll. 
M?:^ 2 0(0 7 n — '^^ A' — h'CUiB^i"^. 

^•rXx-y:/100-C, I-frame^fcti p, B-fran.e > h ^ 7P >y ^ ^ 
^m^^T^. ^_^Xb.J-AA^e>MPEG2kx:t-XhU-A7imai^n. 
EOl-fraioe*^c(i P.B-fra.e > H ^^^^^^^ nfc^^t? 

xx^.y200Tti, 1 ■7^p:rp^y^^^x-^^A-y77<J>^-r^, 

-7^pyp«:/^l^5^-(Dt'^yhXhU-A(^^^« YO ^ DC 

y400(i. S*J2.»fr^C0 DDSKVariable length code)+DDD(dct_dc_si 
ze luininance)(Dbitfi^fi#t. ^>*^'# t V.^^^ Y=0. 1. 
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^(73-7^ayP'y^t::PM(i.j) ^S^^J^^- -^"^^ D(i. j. Y) (islice. 
num=i. -7^Pya'V^_nuin=j. subblock_nuEi=YlC43lj-S DC ^filc^CD 
A(k.Y)Mi6ji^/^i5'->k<75 Y ir:feltS^<7)fiK^^li^> Len(x) 
DC^ee^(75^7!>^x(DBf(DDDSL+DDDCObit:gTS.^o ^3 0llLen(x)^ 
^JAti, Len(O) = Lend) = 3TfeO, DC^fiK^^ LT -O'T^o 
fcsubblock^r • 1 • Xli'-r -^^HTSV^ibit length^i^^^. ^ tjii^^tzi^ 
m^-C^^^'^ DCMEK^A^"4-C$>-.fctl^'3'tC^^?>»{ibit length 

7°500'\jitro 

;57i^^5i^b, m^^^m^^iS^J^^- ^^^^ Y=0.1.2.3lC^tT, 
Len(D(i. j. Y))==Len(D(i. j.Y) + A ' (M(i. j) . Y)) 

Len(D(i.j.Y))==Len(D(i.j.Y) + A"(M(i.j).Y)) .... ^ (2) 
. s^(D-7'^uyuy^\z?' M(i.j) XltP" M(i.j)^ffiii)i2^tr<. --"^^^ 
A'(k.Y). A"(k.Y)fi^n^naJ652.^Ai5^->kmt43tt^P"k. p- 

•kt'^;&Ts^<7)EK5^c^ii^-c'fe^- ^i2)hmtz^nu^^m^^ 

XT7:/8G0TI-fraiDe*/i(i P.B-fraie (TD-f > h 7 ^^^^TT 
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^40lC*gS(^^fiK^^1-^°^^^0^^'^' :rD'y^lOOtiA^$'J 
^^fiT^So ATA^7=-^A;^<7)x-i5'^^«'5. line buffer^ 
mr^mt^no, :/Uy^2Q0\t ime Buffer Tfe^c ^P-y^ 100 
Tgtt^ofcx-i5'^^^t-§A777T$,§. 7D7^300tt I-fram 
e^fcli P.B-frame (D^ > hy':^Oy ^m^^hh. -yuvO 200(D 
x-iS'^i^^), MPEG2 video stream^fe^m L, HtC, I-f raioeS fcti P.B- 
frame (D-Y > h 7 :r □ ^ ^^ttiT^. :/D7^400tt CCmtii^fiT 
cw^a7^400ti, 2^%B^<&7=-i5^A^7=^>^^ai^';/:^(Da 

taHidingT" detection chip)#^cm^iA^T^fflt-^^^^3<^^^^^^ 
y^j:^igfiT$)0« yP7^300TI-frame<^^mbfcm. CCI^^^m-T^ 
^ET^^o yD«y^400ti CCI^^rnDt^-^. CPUlIinterrupt=S:± 
frf:5>o a±(O:/D>:/^:' 1007:?^e)^D-:'^4003gti. x-i5'A^T^>^^ 

i^{c:/o«y^500li-7^p:/p«;/^A^y:7 7T«.^c yp;:^ ^500ii i -7 
^p:/p«y^^(^rt^^i*^i"^,^e'^^^' yp^y^eooti DciiSfie 
^^m^fi-^^^^o - -^-^^ p :/p >y ^ e,DC<7))S^fi5c^(Y=o. 1 

.2,3)^^ai-r^. :/D^y/7 7ootiMSL^f§^^fi'^'*^«' ^(7)yp«v 

/7700liSi6iA^Ai5'-><75^^fiiSL^(W(i'-'^^^^^'^^^*"^*^° 

1-7^P^P>:/^{' 2bit:^^*fiJ«9^Te.n^c fci:AliMP@ML(72 

o''x480)CO«feV^. 720/16*480/16*2 = 2700bit Sr^^f ^ . 7P«y^800 
tiDChuffmantableTS,^. il-CMPEG20DC(7))S«fiK5^<7)huf fman ta 
ble(ISO/IEC 31818-2mableB.12)^^i^-r^o ^P«y^900ti DC huff 
.an lengthit^^fi-Cfe^c DCO)iSeK^<^DDSL+D 
DDCDbit^«i^^^J:V^A^^*^'5/^&5ilg'r^i6^«rfeOo :/P«y^l000 
ti DC Sii*3i^ (re-embedding) ^gTfe^. ^ P ^ lOOOti, :/P 
>y^900TbitS7&^*^^^e.^cCl^^^> yD.y^700T#?>nfcAi5'->$: 
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jl,^'^(D-7i7U':ruy^^ bit stream x-:^' AX(Cffi:^T^. 

:^tB{ii^T<75^li'Cff ^. I- fraffle7:)^(ietect^nfcl^, DC(i.j.Y)$: DC 

(Dwrn^^ {i,j.mmmt±Bmtb^^^mmzm\:)^ p(M(i,j).Y)^ 

li463i^^/^^-> (embedding pattern) M(i. j) (75YlcMT^iiJ63i^ 

ADC(i.j) = DC(i. j.O)-DC(i. j.l) ,M(i.j)=0 
DC(i, j,0)-DC(i. j,2) .M(i,j)=l 
DC(i. j.l)-DC(i, j.O) ,M(i.j)=2 
DC(i. j,2)-DC(i. j.O) ,M(i.j)=3 

S^ZjADCCi, j)/N --> 0 
({iLN it ±|S22(Dtf^lC^t)n;fcADC(i.j)(75lltT$.S) 

2j2jADC(i. j)/N --> A>0 

a2 = 2jSj(ADC(i.j) - < ADC(i. j)»2/N 

z =2:j2jADC(i. j)/(a*N) 
i^i. ^Sthreshold TH*tL. T <*z7^j: e> «ffiJ6ii^Ji"Yes". T>zti^ 
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T^^<r>^^^'y7s^h(D^^ti^^t.nX\^^^ (DVD CPTWG DHSG CFP V 

mm^mx'f'j^)V9-'^ir^(bQz\ = a, o) (copy once) tj^^ a ^n^c 

^. frfcPiCCI (Extended CCI. £(TECCI) t , "ECCI/j:L 

" (Dm^^mzQi^mibTL^mm^v^-^-th. "Ecci$.t)" o^-^ti^® 

CopyllEl<D^^pJ(75i/;^xA$:||5im3|5-5. ^5iaiC 

x>^^;Hf^7=-^;Jt«, :7o 7^510(75STB (Set Top Box) T§{i^n. 

15 m5:fTV^> ^^tntzm-^. 7n>y^530T ECCI /&^*-57&^t*^;6^iplJ^ 

$n^. ilC-e. ECCItS^'^O (yes) (l:2|siJ^$n;^c#-&}i7'P«;/i^56 

Z.(r>i/7sy'L.(Dm,^.t\^X\t. 
20 1. MPEG2 KP^-f >±T(7)'J7;UiS'-rA(DECCI ffiJe)3i^7&^* pJigT^ , 

^(DW^^v V{t-^nfzm\i format to 
2. MPEG2^Jgg^L7'r^C7)^-xn> K. DA^J^^fTo ;t^C73 7:^n ^ K 
p^-O (Analog domain) e)<^^ai t) oJigTa&^ 31 i:, 

25 4. #l^¥9-0884937ici:(75Token}S-crB!^<i:?'j:-2>jijiiiigS{C:}3tt^X7-- 

H J: ^ECCIa)^mi^tS<7)^^b<^'tL^S275^^iU d i: o 
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if ^ (7) i! a 
(1) \iftT-^^^im^y \y-^<^^ii!i'^'<r'^^^^> 

(3) tfrfaA*-:/7 7 u>^$n75:/KM^(;s fx^tx-^J'T. h u-ao 

fi$7:>^^^<i:7'cj: Settle. #JPlf^^a*jZity^^«i:. 

2. BiifEt'x:tx-^75mP E G(7)k'x:r7=-i5^T^^^ If LIB® 
(7) 7. -r A . 

3. HfflB®^7U-A;0mPEGt:x^-7=-^C7) I-frame ^fcti P.B- 
frame <D-(> hyZ^O-j ^X'h^^ fl*^ 2 IS«COv Xt" A. 

4. BfriH'#Jpt»^^iiJ6^tr¥© (3) f}^ 

(3 b) mumm^Mi^jhtsWAZ. B(ffEDCfie^(7)t:>y h:g^^'^^T$> 

(3 c) mm^^^y hm^^^<7)m'^^ #3^nif^^A*>:/77U>^$nfc 
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7. HirE/h^J^/^>^ l-^^U^Uy^ (1 6 X 1 6 f^ilJl') W^^T 

9. \iy't7''-:^^nmmmt:mtbjhtsiimrst>ox. 

(1) k*x^x-^7&^e)®^71/-i.(7)^ai$ff 5^Pit^ 

(2) |trfB®^7 U-ATS^^iB^nAcii-a-. f>rl2®^7 U-AT^^^e./jN^ 

(3) ai5A*«y77 U>^^n75:/hM^{I. t*7=:t-7=-i5'X h U-AO 

o 

9 . MP E GX h ^J-2^^n=?-Mf)^L^mtbj^t5:^^^V$,-:>X. 

(1) MP E GX h U-A3&^^) l-frme ^tzit P.B-frame <D^>hy 

(2) MfEI-frame P.B-frame O-T > h ^ 7^^ ^ ^ n 

ffilSMPEGT. hU-A75^e>l □T'P >:/^^07=-:$'^® 
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(3) SfriaA*'y77 U >^^n;^c:-7^pyp>yi57{c, VLC(D^-^f}i^ 

(4) /-^ ^ - ^ U y n y C^^UP EG (D 7. hU-A 

10. t'x:fT-r$'>t'CD#jaif^^^ai-r^:;^)*-efeoT. 
10 (3) B>riH/N*7 7 7 'J >^$n/i/jNM^tf'tc#*nif$B:d^*^^;5^&^m-r 

1 1. MP EG7. h iJ-Ac^>wm?S75^L^^aiT'?>:^feT$>oT. 

(1) MP E G7. h ij I-frame ^itfi P.B-frame (D-r>h^ 

15 •:ruy^(D^m^fTZ>mt. 

(2) H?rlHI-frame^fcli P.B-frame (D-i > h y y ^ ntz 
^-^^ ttrlBMP EG;^ h U-ATi^^l D^P «y ^^(T^x-rS'SrlKO 

( 3 ) MIB/N* yy7^)>iftntz^^u-:fUy^^(DDC^^ \zm^jh 
20 tnfc>'^^->75t$)^d^^^mT^©pg<i:. 

<£Wr^JI^^4#IS<i:TS, MPEGm^-j^T^^t^m:^?*. 

(1) A:/7x-i5'35^e>CC I <£^mT-5¥®<i:, 

(2) cc I T^^'^m^nfcii'^, A:^x-^7i^e)Ecc I <i:^m-r^^ 

25 

(3) EGG I T^^'i^m^nTt^-^, T'i^^jv • y'-:^<^w.m^m±t^ 
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(4) E CC I TS^^m^nncV^Ji-^, xx^JV • x-^^ECC I 

5 13. \i'r^'f-9^mmn^m^^^t^M(^':^^^^j^'^^t^^^ 

(1) t*7=:tx-i5'*^e>H^7 U-A(75^m^fT5«itii:s 
10 (3) SfriSA*«y77U>^$n/2:/h^^lC. t*7=:t7='-i$'7. h U -AO 

o 

15 14. t'7';r7=-:5'tf3(7)MJPlf^$^£Br§fc36(7)7'a^^A<&^tJ^« 

(1) t*7=:tr-^$'75^e>®#7 U-AO^m^fraatgi. 

(2) Hfria®#7U'-A;i>^^{±i^n/cJi-^. t(flB®^7l/-A*^e>/jN^ 

20 (3) tiiB&^'^yyr^J >'^^nrz4^mi$.^izma^m^^^-^^'^^ihr 
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